(12) United States Patent 

O'Connor 



US006480667B1 

(io) Patent No.: US 6,480,667 Bl 
(45) Date of Patent: Nov. 12, 2002 



(54) METHOD OF TIME SHIFTING TO 

SIMULTANEOUSLY RECORD AND PLAY A 
DATA STREAM 

(75) Inventor: Dennis M. O'Connor, Chandler, AZ 
(US) 

(73) Assignee: Intel Corporation, Santa Clara, CA 
(US) 

( * ) Notice: Subject to any disclaimer, the term of this 
patent is extended or adjusted under 35 
U.S.C. 154(b) by 586 days. 

(21) Appl. No.: 08/996,535 

(22) Filed: Dec. 23, 1997 

(51) Int. CI. 7 H04N5/91 

(52) U.S. CI 386/83 

(58) Field of Search 386/83, 46-52, 

386/92, 4, 40, 724, 125, 126, 45, 105, 106; 

H04N 5/91, 7/08,-5/85 

(56) References Cited 

U.S. PATENT DOCUMENTS 
5,134,499 A * 7/1992 Sata et al 386/109 



5,479,302 A * 12/1995 Haines 

FOREIGN PATENT DOCUMENTS 



360/69 



JP 
JP 
JP 
JP 



2-44569 

7- 264529 

8- 237592 
10-56620 



2/1990 
10/1995 
9/1996 
2/1998 



OTHER PUBLICATIONS 



"Hitachi Plans Flexible DVD Video Recorder", Electronic 
Engineering Tunes, p. 8, Jun. 16, 1997. 

* cited by examiner 

Primary Examiner— Robert Chevalier 

(74) Attorney, Agent, or Firm—Trop, Pruner & Hu, P.C. 



(57) 



ABSTRACT 



A video stream is received at an input. The video stream is 
recorded to a storage unit. While the video stream continues 
to be recorded, a portion of the video stream is retrieved 
from the storage unit and provided at an output. In one 
embodiment, the storage medium is a random access storage 
unit, such as a hard disk. 
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FIG. 2 
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FIG. 3 
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FIG. 4 
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METHOD OF TIME SHIFTING TO 
SIMULTANEOUSLY RECORD AND PLAY A 
DATA STREAM 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The described invention relates to the field of imaging. In 
particular, the invention relates to the recording and playing 
back of a video stream. A video stream includes any com- 
bination of audio and/or video data streams. However, the 
concepts disclosed may be applied to other types of data 
streams. 

2. Description of Related Art 

Video streams have typically been recorded on analog 
media such as a video cassette. A video cassette recorder 
(VCR) is used to record the video stream on the video 
cassette. The video stream may come via a broadcast signal, 
via cable, via satellite signal, or from another video playback 
device. Once the video stream has been recorded, the VCR 
is used to rewind the recording medium and play what was 
recorded. However, due to the nature of the analog medium, 
once the VCR has started recording, it is not possible to play 
back the portion of the video stream that has already been 
recorded until the recording session is terminated. 

For example, imagine that a person sets up a VCR for 
recording a one hour show because he knows that he will 
miss the first 15 minutes of the show. When he arrives home 
15 minutes into the show, he will have to wait for the entire 
show to be recorded before he can start watching the 
program from the beginning. Away of being able to view the 
show from the beginning without having to wait for the 
recording session to terminate is desirable. 

SUMMARY OF THE INVENTION 

A method of providing a time-shifted video stream is 
disclosed. A video stream is received at an input. The video 
stream is recorded to a storage unit. While the video stream 
continues to be recorded, a portion of the video stream is 
retrieved from the storage unit and provided at an output. In 
one embodiment, the storage unit is a random access storage 
unit, such as a hard disk. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows a block diagram of a video record and 
playback system in accordance with one embodiment of the 
invention. 

FIG. 2 shows a flowchart of the method of providing a 
time-shifted video stream. 

FIG. 3 shows one embodiment of performing block 206 
of FIG. 2. 

FIG. 4 shows one embodiment of an apparatus for storing 
the video stream on a hard disk. 

FIG. 5 shows an exemplary method of using the storage 
unit as a temporary buffer. 

FIG. 6 shows a flowchart of the playback of a video 
stream catching up to the incoming video stream. 

FIG. 7 shows another embodiment, in which the user is 
able to suspend the display of the incoming video stream. 

FIG. 8 shows an example of a display screen with several 
image frames taken at different times. 
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DETAILED DESCRIPTION 

The Apparatus 

FIG. 1 shows a block diagram of a video record and 
playback system 100 in accordance with one embodiment of 

5 the invention. A video stream is received at the VIDEO IN 
102. The video stream may be provided by a camera, a 
television signal, broadcast, cable, or satellite signals, or 
another video playback device. In one embodiment, the 
VIDEO IN 102 performs an A to D function that takes 

10 analog NTSC signals coming in and decodes the video 
stream into a digital video bit stream. In a different 
embodiment, the video is already in digital form. In one 
embodiment, video record and playback system 100 is a 
personal computer system, and the VIDEO IN 102 is a video 

15 capture card plugged into the personal computer system. 
The video stream output of the VIDEO IN 102 is option- 
ally compressed at compression unit 104. In one 
embodiment, the video is already compressed, such as 
would be the case with an MPEG2 video signal, and no 

20 further compression is needed. The video stream is then 
stored into storage unit 108. Buffer unit 106 may be used as 
a temporary storage unit for providing larger sequential 
blocks of video data to the storage unit 108. 
In one embodiment, storage unit 108 is a random access 

25 memory unit that allows relatively quick access to any 
portion of the stored video stream. A hard disk is an example 
of a random access memory unit. A hard disk can typically 
access stored data with access times that are on the order of 
10 ms. In contrast, video cassette tapes are mechanically 

30 wound to get to a particular point in the video stream. 

The video stream is played back by reading the video 
stream from the storage unit 108. If the video stream was 
compressed in compression unit 104, then a decompression 
unit 110 decompresses the retrieved video stream. The video 

35 stream is provided to a VIDEO OUT port 120, to which a 
monitor or other display device is connected to provide 
sound and/or video to a user. 

A removable storage unit 122 may also be included in 
video record and playback system 100. Examples of remov- 

40 able storage units are a writeable CD ROM, write able DVD, 
a flash memory, or another hard disk. The removable storage 
unit 122 allows a user to transfer a recording of a video 
stream stored in storage unit 108 to the removable storage 
unit 122. 

45 In one embodiment, a processor 130 controls the opera- 
tions of the video record and playback system 100. The 
compression unit 104 and decompression unit 110 may be 
implemented in hardware, or the compression and decom- 
pression functions of units 104 and 110 may be performed 

50 by the processor 130. Processor 130 receives instructions 
from firmware/memory 140, using technology that is well- 
known. 

Record and Playback Cycle 

FIG. 2 shows a flowchart of the method of providing a 

55 time-shifted video stream. The flowchart begins at block 
200, and continues at block 202 at which the video stream 
is received at an input. The video stream begins being 
recorded at block 204. At block 206, playback of the video 
stream that has been recorded is performed by retrieving a 

60 portion of the video stream from the random access storage 
unit while the recording of the incoming video stream 
continues. The retrieved portion of the video stream is 
time-shifted from the incoming video stream by a time 
delay. 

65 At block 208, the portion of the video stream retrieved 
from the random access storage unit is provided at an output 
of the video record and playback system 100. The retrieved 
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portion of the video stream can then be displayed by a manner, the temporary buffering of the video stream acts as 

television or other display device. a circular buffer In one embodiment, the processor 130 

By using the method of FIG. 2, the record and playback maintains pointers to the beginning and ending points of the 

functions are decoupled from one another. The user may temporary buffer. Hie processor 130 reassigns the painters 

now begin watching a recorded TV show from the 5 as newer portions of the video stream are received and/or 

beginning, i.e, prior to the show being completely recorded. older portions of the video stream are overwritten. 

FIG. 3 shows one method for performing block 206 of FIG. 5 shows a flowchart of one method for using the 

FIG. 2 of retrieving a portion of the video stream from the storage unit as a temporary buffer. The flowchart starts at 

random access storage unit while continuing to record the block 500 from which it continues at block 502, at which the 

incoming video stream. In the disclosed embodiment, the 10 video stream is received at an input. Recording of the video 

simultaneous recording and playback of the video stream is stream to the storage unit begins at block 504. At block 506, 

performed by alternately performing, or multiplexing, one or older portions of the video stream are deleted as newer 

more stores of the video stream to the random access storage portions of the video stream are stored to the storage unit, 

unit with one or more reads of the video stream from the A user may initiate a playback cycle following block 506. 

random access storage unit. The multiplexed stores and 15 For example, this may occur when the user wishes to 

reads occur quickly enough that the user does not notice an re -view a video clip that he just saw. In one embodiment, the 

appreciable delay in the playback of the video stream, and user stops recording to the temporary buffer and plays back 

none of the incoming video stream is lost, i.e., all of the the last portion of the temporary buffer, 

video stream is recorded. Thus, the record and playback are However, it may be more desirable to the user to be able 

simultaneous from the user's point of view. 20 to continue recording as shown at block 508. A record and 

In one embodiment, the random access storage unit is a playback cycle (as described with respect to FIG. 2) is 

hard disk. The retrieval of the time-shifted video signal from started, in which the incoming video stream is recorded 

the hard disk is performed at a first physical location (or while the user re-views the last portion of the temporary 

sector) of the hard disk, and the storing to the hard disk of buffer. In this manner, after re-viewing the desired video 

the incoming video stream is performed at a different 25 clip, the user can resume sequentially watching the video 

physical location (or sector) on the hard disk. Because it stream from the point of the video clip, 

takes more time to jump back and forth between different At block 510, after the record and playback cycle is 

sectors of the hard disk than the time it takes to read and completed, all or part of the temporary buffer may be saved, 

write to sequential locations in the same sector, data may be Since the temporary buffer store the latest X minutes of the 

buffered to minimize the number of accesses to and from the 30 video stream prior to the record and playback cycle, all or 

hard disk using buffer 106. This increases the amount of data part of the temporary buffer may be allocated to the portion 

transferred per access. of the video stream saved during the record and playback 

Additionally, because of time constraints for reading and cycle. Other portions of the video stream may then be 

writing to the hard disk, data may be compressed and deleted from the storage unit, or they may be marked as 

decompressed to speed transfers to and from the hard disk. 35 over-writeable and used as a new temporary buffer. 

In block 302, the video stream is stored to a random Playback Catching Up to Incoming Video Stream 
access storage unit. The video stream is optionally com- FIG. 6 shows a flowchart of a method for playing back of 
pressed and/or buffered prior to storage. In block 304, the a video stream in a manner that allows it to catch up to the 
video stream retrieved from the random access storage unit. incoming video stream. Usually, during simultaneous play- 
Buffering and/or decompression may be performed before 40 back and recording of the same video stream, the playback 
providing the retrieved video stream to the VIDEO OUT of the video stream is time -shifted from the incoming video 
port 120. stream by a time delay. However, if the playback is per- 

From block 304, the flowchart proceeds at block 306 formed at an overall rate faster than the rate at which the 

which stores the next portion of the video stream in a manner incoming video stream is received, then the playback will 

similar to that described in block 302. At block 308, the next 45 catch up to the incoming video stream, 

portion of the video stream is retrieved in a manner similar For example, playback of the video stream will have an 

to that described in block 304. This process is repeated until overall rate faster than the rate of the incoming video stream 

either the recording or playback cycle is terminated. if the playback is fast forwarded, or if segments of the 

FIG. 4 shows one embodiment of an apparatus for storing playback are skipped altogether. When the time delay of the 

the video stream in the storage unit 108. In this embodiment, 50 time-shifted video stream being played back falls below a 

the video stream is stored as separate files 001 to 009 on a certain threshold, the video and playback system 100 will 

hard disk, for example. The processor 130 keeps track of the cease providing the time-shifted video stream from the 

file and offset into the file of the data being played back, as storage unit. Instead, the incoming video stream will be 

well as the file and offset into the file of the data being provided to the VIDEO OUT port 120 directly. In one 

recorded. If the random access storage unit is fast enough, 55 embodiment, a bypass 142, as shown in FIG. 1, allows the 

the more than one video stream can be recorded and played incoming video stream to be provided to the VIDEO OUT 

back at the same time. port 120 directly. 

Temporary Buffering (Circular Buffering) When this happens, the user has caught up to the "live 1 * 

Due to the nature of the random access storage unit being broadcast, i.e., the incoming video stream. The user may 

capable of easily recording over itself, the random access 60 terminate the recording cycle, if he wishes. Alternatively, the 

storage unit may act as a temporary buffer for recording the user can put the video record and playback system 100 back 

latest portion, or X number of minutes, of an incoming video into the temporary buffering mode in which only the latest 

stream, where X is set up based upon the size of the storage portion of the video stream is stored, 

unit. In one embodiment, X could be set up to be the entire "Suspending" Incoming Video Stream 

storage unit. As newer portions of the video stream are 65 FIG. 7 shows another embodiment, in which the user is 

received, they will overwrite the older portions of the video able to suspend the display of the incoming video stream, 

stream saved in the random access storage unit. In this This can be used for example, when the user is interrupted, 
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and wishes to continue viewing the video stream after the 
interruption. When interrupted, the user signals to the video 
record and playback system 100 to suspend the display of 
incoming video stream. This can be done via a remote 
control, for example. At block 702, the video out is sus- 
pended. In one embodiment, the VIDEO OUT continues to 
provide a still image of the image present at the VIDEO 
OUT when the suspend was encountered. 

At block 704 of the flowchart, the incoming video stream 
is recorded but is not displayed to the monitor. Instead the 
playback is paused at the point at which the user indicated 
that the incoming video stream be suspended. When the user 
is ready to view the video stream again, he can signal the 
video record and playback system 100 to un-suspend the 
video stream so that it plays back from the point at which the 
video stream was suspended, as shown in block 706. 

The user may then view the video stream time shifted by 
the amount of time that he suspended the incoming video 
stream, or he may fast forward (or rewind) through the 
time -shifted video stream. When playback of the time- 
shifted video stream catches up to the point at which the 
incoming video stream is being recorded, the record and 
playback system 100 may display the incoming video stream 
directly from incoming video stream without retrieving the 
video stream from the storage unit, as described with respect 
to FIG. 6. The recording of the video stream may then be 
terminated by the user, if desired. 
Story Boarding: Fast Forward and Rewind 

Employing a random access storage unit for storage of the 
video stream facilitates jumping to various points within the 
video stream. One way of jumping is by retrieving different 
time slices of the video stream. For example, an image frame 
from the video stream can be retrieved from the storage unit 
at 1 minute intervals from a current position of the video 
stream. In one embodiment, an image frame at the current 
playback position+1 minute, current playback position+2 
minutes, and so forth are retrieved and displayed on the TV 
screen. 

FIG. 8 shows an example of a display screen 800 which 
displays several image frames taken from the video stream 
at different times. In FIG. 8, the current playback position is 
designated as X. In one embodiment, the time interval, T, is 
user programmable. The intervals may be multiples of the 
time interval, as shown. A small interval may be used if the 
user wishes to skip a commercial, which usually lasts only 
a few minutes. Longer intervals such as a half hour may be 45 
useful for determining which movies are recorded on a 
storage unit. 

After the image frames are displayed, the user is able to 
select one of the frames as a new starting point to which to 
begin an operation, such as a playback or record operation. 
By using such a story boarding method, it is easy for a user 
to quickly jump to a desired location within the video 
stream. 

In one embodiment, the record and playback system 100 
is able to detect a black screen or fade out, such as those 
which accompany the beginning or end of a commercial. 
This is useful in editing a video stream. 
Editing 

Having the video stream stored on a random access 
storage unit such as a hard disk allows for easy editing of the 
video stream. Individual frames of the video stream may be 
deleted or replaced. For example, a commercial may be 
replaced by a fade-to-black sequence. 

Once the video stream on the storage unit has been edited, 
it can be stored to a more permanent medium such as a 
writeable CD-ROM, flash memory, or another hard disk via 
the removable storage unit 122. 
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CONCLUSION 

Thus, a method of simultaneously recording and playing 
back a time-shifted video stream is disclosed. The specific 
arrangements and methods described herein are merely 
illustrative of the principles of this invention. For example, 
the same method may be used to store and retrieve other 
types of data streams besides video streams. Numerous 
modifications in form and detail may be made without 
departing from the scope of the described invention. 
Although this invention has been shown in relation to a 
particular embodiment, it should not be considered so lim- 
ited. Rather, the described invention is limited only by the 
scope of the appended claims. 

What is claimed is: 

1. A method of displaying a video stream comprising the 
steps of: 

(a) receiving the video stream at an input; 

(b) initiating one or more stores of the video stream into 
a storage unit; 

(c) initiating one or more random access reads of the 
video stream from the storage unit, wherein the one or 
more stores of the step (b) are multiplexed with the one 
or more reads of the step (c); and 

(d) displaying the video stream. 

2. The method of claim 1 wherein the one or more reads 
of the video stream from the storage unit are used to play 
back the video stream at a rate faster than it is being stored 
in the step (b). 

3. The method of claim 1 wherein the one or more reads 
of the step (c) correspond to the video stream of the step (a) 
shifted by a time delay, wherein when the time delay falls 
below a predetermined amount of time, the one or more 
reads from the storage unit cease, and the step (d) is further 
comprised of the step of: 

(d) displaying the video stream received in the step (a). 

4. The method of claim 1 wherein the one or more reads 
of the step (c) access the video stream onset by a time delay 
from the video stream being stored in the step (b), the time 
delay being variable over time. 

5. The method of claim 1 further comprising the step of: 

(e) retrieving two or more frames of the video stream 
shifted by different time delays; 

(f) displaying the two or more frames of the video stream; 
and 

(g) allowing a user to select one of the frames of the video 
stream as a starting point for playing back the video 
stream. 

6. A method of displaying a video stream, the method 
comprising the steps of: 

(a) receiving the video stream; 

(b) storing the video stream received in the step (a) to a 
storage unit; and 

(c) displaying the video stream at least initially delayed by 
a time delay, wherein when the time delay is greater 
than a predetermined threshold the video stream is 
displayed from the storage unit, and wherein when the 
time delay is less than the predetermined threshold the 
video stream is displayed from the video stream 
received in the step (a). 

7. The method of claim 6, wherein the step (b) of storing 
the video stream to the storage unit comprises performing 
one or more stores to the storage unit, and the step (c) of 
retrieving the video stream from the storage unit when the 
time delay is greater than the predetermined threshold 
comprises performing one or more reads from the storage 
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unit, and the one or more stores to the storage unit are 
multiplexed with the one or more reads from the storage 
unit. 

8. The method of claim 7, wherein the storage unit is a 
random access memory unit, and the one or more reads from 5 
the storage unit retrieve the video stream with one or more 
time delays that are user-specified. 

9. The method of claim 6, wherein the step (b) of storing 
the video stream to the storage unit further comprises 
compressing the video stream prior to storing the video 10 
stream to the storage unit. 

10. The method of claim 6, wherein the step (c) of 
retrieving the video stream from the storage unit when the 
time delay is greater than the predetermined threshold 
comprises decompressing the video stream after retrieving 15 
the video stream from the storage unit. 

11. A method of recording a video stream, the method 
comprising the steps of: 

(a) receiving the video stream; 

(b) displaying the video stream as it is received; 20 

(c) responsive to a first user input, suspending display of 
the video stream and storing to a storage medium the 
video stream received subsequent to the first user input; 

(d) reading the video stream from the storage medium to 
provide the video stream at the output; and 
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(e) wherein the video stream read in step (d) corresponds 
to the video stream received in step (a) shifted by time 
delay, wherein when the time delay falls below a 
predetermined amount of time, providing at an output 
the video stream received in step (a) without first 
storing the video stream to the storage medium. 

12. The method of claim 11 wherein reading the video 
stream from the storage medium in the step (d) is performed 
at an overall rate faster than a rate that the video stream is 
being received. 

13. The method of claim 12 wherein reading the video 
stream from the storage medium is performed by skipping 
portions of the video stream. 

14. The method of claim 11 further comprising the step of: 

(f) retrieving two or more frames of the video stream 
shifted by different time delays; 

(g) displaying the two or more frames of the video stream; 
and 

(h) allowing a user to select one of the frames of the video 
stream as a starting point for playing back the video 
stream. 
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